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Image processing of HCMM-satelllte thermal images fob superposition 
with other satellite Imagery and topographic and thematic maps 

Abstract 

Heat Capacity Mapping Mission (HCMM) is the first of a series of 
low-cost, modular-design space craft built for the Applications 
Explorer Missions (AEM) . This mission was designed to allow scien- 
tists to determine the feasibility of using day-night thermal in- 
frared remote sensor-derived data. HCMM was launched on April 26, 
1978, into a nearly sun-synchronous 620 km circular orbit inclined 
97.6 degrees to the equator. The selected orbit has a 16-day re- 
peat cycle. The HCMM carries a single sensor called KCMR (Heat Ca- 
pacity Mapping Radiometer) which is a two-channel scanning radio- 
meter providing measurements of reflected solar and emitted thermal 
energy. Under the leadership of the Joint Research Centre of the 
European Communities in Ispra (Northern Italy) a consortium of se- 
veral European investigators conducts studies of soil moisture and 
heat budget evaluation of HCMM-data in selected European Zones of 
agricultural and environmental interest (TELLUS-Project) . The objec- 
tives of this paper ares How exact a regionally bounded KCMM-scene 
can be rectified with respect to a preassigned coordinate system. 
Related to this problem is the question of the scale to which ex- 
cerpts from HCMM-data can be sensibly enlarged or how large natural 
topographic structures must be in order to identify them in a sa- 
tellite thermal image with the given resolution. 

Furthermore, an attempt will be made to superimpose within the com- 
puter the HCMM-data with other information , especially relief and 
forest and population distribution maps, but also with a land-use 
map, which has been derived from LANDSAT data. Here it is necessary 
to digitalize the maps and to adapt them to a common reference system 
and to combine the various information levels in a single multi- 
channel data-structure. As area under investigation a section has 
been chosen from the southwestern part of Central Europe between 
the cities Basel and Frankfurt. This section comprises the Upper 
Rhine Valley and the surrounding highlands. The digitalization of 
the maps was achieved after a photographically preprocessing by 
scanning 6 x 6 cm 2 slides with a flying-spot-scanner of the DIBIAS- 
system, which was the digital image processing system used for the 
described y/ork. After the digitalization, all maps have been fitted 
to the reference system and in this way to each other. For the geo- 
metrical rectification of the maps and the original HCMM data the 
interpolation method with control points for the calculation of the 
parameters of the mapping functions have been used. In order to 
achieve the highest possible degree of precision the determination 
of the control points has been carried out in two steps. First, the 
thermal-image has been corrected with respect to the water network 
and the forest distribution. From the thermal image treated in this 
way - and which already approaches in its geometry the topographical 
map - the control points for the rectification have been deter- 
mined using the coordinates of the reference system. The final rec- 
tification yielded a r.m.s. error of about one pixel (618 m and 
408 m) . After the geometrical rectification the several information 
channels have been merged to one multi-channel scene which could be 
evaluated in several different manners, like the correlation of sur- 
face temperature and relief, surface temperature and land-use and 
surface temperature and built-up areas. 
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1 . introduction 


1,1 Heat Capacity Mapping Mission (HCMM) 


HCMM is the. first of a series of low-cost, modular-design space 
craft built for the Applications Explorer Missions tAEM) , This 
mission was designed to allow scientists to determine thu feasi- 
bility oi using day-night thermal Infrared remote sensor-derived 
data for [1 ]: 

• Discrimination of rock types and mineral resource locations, 

• Measuring soil moisture effects by observing the temperature 
cycle of soils. 

• Measuring plant canopy temperatures at frequent intervals to 
determine the transpiration of water and plant stress. 

• utilising frequent coverage of snow fields for water runoff 
prediction . 

• Measuring effects of urban heat islands. 

• Mapping surface thermal gradients on land and in water bodies, 

HCMM was launched on April 26, 1978, into a nearly sun-synchronous 
620 km circular orbit inclined 97,6 degrees (retrograde} to the 
equator. At northern hemisphere mid- latitudes, the crossing times 
are about 1 : 30 p.m and 2; 30 a.m. The selected orbit has a 16- 
day repeat cycle. This orbit results in satellite night/day cover- 
age patterns at least once every 16 days at approximately 12-hour 
intervals for all latitudes poleward of 35 degrees, and all lati- 
tudes equatorward of 20 degrees. 

The HCMM carries a single sensor called HCMR (Heat Capacity Mapping 
Radiometer) . This instrument is a two-channel scanning radiometer 
providing measurements of reflected solar and emitted thermal 
energy. Pig. 1 summarises the major characteristics of the HCMR: 


Orbital altitude 
Angular resolution 
Resolution 

Swath width 
Thermal channel 

Usable range 
Visible channel 
Dynamic range 


a 620 kilometers 
« 0.83 milliradians 

- 0.6 km x 0,6 km at nadir (inf rared) 
0.5 km x 0.5 km at nadir (visible) 

- 716 kilometers 

10.5 to 12.5 micrometers 
NEDT « 0.4 K at 280 K 
« 260 to 340 K 

= 0.55 to 1.1 micrometers 

* 0 to 100 % albedo 


Pig. 1 : Heat* Capacity Mapping Radiometer Summary Data Sheet 
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NASA had some problems with the calibration of the thermal data 
since alter launch of the HCMM some instrument characteristics 
chanced slightly for unknown reasons. Consequcnly IICMM surface- 
temperatures in this paper have been provisionally calibrated and etc 
might have to correct them lator, 

NASA had planned a mission-duration of one year. Information con- 
cerning the data available up to now will be given in section 2.3. 

1 . 2 TKLLUS-hr eject 

Under the leadership of the Joint Research Centre of the European 
Communities in Xspra (Northern Italy) a consortium of several Eu- 
ropean investigators conducts studies of soil moisture and heat 
budget evaluation of HOMM-datu in selected European sones of agri- 
cultural and environmental interest (TELLUS -Project) » 

Anticipated results are: 

• Seasonal mapping of soil moisture? 

• monitoring of vegetation stress; 

• relationships between soil moisture, groundwater and erosion? 

• frost tendency monitoring and 

• effect of heat sources and sinks on regional heat budget. 


Some special interests of the Geographical Institute I of the Uni- 
versity of Freiburg \ GEOI3? ) in the frame of TEU,US —P ro 3 ec t are { 2} • 

• Connection between the patterns of surface temperatures, respectively 
day/night temperature differences and the geographic reality 

of various natural surfaces with a different physical consti- 
tution (forests, farmland, settling areas etc.) by comparison 
with already available special maps mainly in the scale 
1 : 1 , 000 , 000 . 

• Correlation between surface temperatures or their 
variations and the nature of surface coverage. 


• Analysis of the influence of altitude, topographic situation 
and regional meteorologic conditions on the temperature of 
surface elements of the same kind. 


• Thermal behaviour of different regional units in southern Ger- 


many . 

1.3 Objectives 


of ; 


tVu?;,: (iS . 

A * * £*** 


In this paper two questions, both of primary importance for the 
application of HCMM- .image, material with regard to the above-men- 
tioned goals, will be examined. 

It will be examined, how exact a regionally bounded HCMM-seene 
can be rectified with respect to a preassigned coordinate system 
(in this Oifie the Gauss-Krilger System for the official maps of the 
Federal Republic of Germany) . Related to this problem is the que- 
stion of the scale to which excerpts from HCMM-data can be sen- 


sibly onlarvjed or, conversely, how large natural topographic struc- 
tures must be in order to be identified accurately in a satellite 
thermal image. This information is a prerequisite for all evalu- 
ations in which HCMM data are related to terrestrial observations 
or measurements. 

Furthermore, an attempt will be made to superimpose computation- 
ally point for point the HCMM- image data with other informations, 
especially relief and forest and population distribution maps, but 
also with a land-use map, which has been derived from LANDSAT data. 
Here it is necessary, on the one hand, to digitise the maps and 
to rectify them, likewise with respect to the Gauss-Krtiger coordi- 
nate system, and, on the other hand, to combine the various infor- 
mation levels in a single multi-channel data-structure. The there- 
by requisite methodological steps and the accompanying difficul- 
ties, as well as some evaluations of the resultant data-structures, 
will be presented below. 


1 . 4 The area under investigation 


For this study a section has been chosen from the southwestern part 
of Central Europe between the cities of Basel and Frankfurt (Fig, 2) . 
This section comprises the so-called Upper Rhine Valley and the 
surrounding Highlands. There are several reasons for this choice: 

Both sides of the Rhine river are exemplified by a variety of land- 
scape types: the holocene flood plain with residual forests; the in- 
tensely cultivated quarternary accumulation plain, interspersed in 
some places with forested sand and gravel terrain; the orchards and 
vineyards of the foothill zone; the strongly dissected forested 
ascent to the mountainous flanks of the Graben; forested plateaus, 
extending away from the Upper Rhine Valley and divided by large val- 
leys, and which on the side away from the Rhine are bounded by a 
wellmarked rock formation and thereafter replaced by a relatively 
unforested farm landscape. 

On the Upper Rhine Valley there are several very densely populated 
regions, like Frankfurt and Mannheim-Ludwigshafen in the Federal Re- 
public of Germany, Strasbourg in Franco, and Basel in Switzerland. 
Outside of these centres with their great need for space, a strong 
industrial development is taking place, especially along the Rhine 
river on the German and even more so on the French side, a develop- 
ment which in this area has led to an active discussion about the 
possibilities of a man-made modification of the regional heat-budget 

m. 

Flights carried out in 197(> by the German Aerial Surveying Program 
have made available day and night thermal- images for several sec- 
tions of the area in question. These images can be combined with 
HCMM data [2 J. 

As the result of a study on the evaluation of LAND SAT data for the 
preparation of land-use data to be used in regional planning there 
is already available a digital map of the Mannheim area with the 
territory classified into eight land-use classes. This allows a 
direct combination with HCMM data [4] . 
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Fig. 2: 


The area under investigation 

CO 6310, CC 7110, CC 7910 and CC 8710 are sheet-numbers 
of the official Topographical Map 1 : 200,000 of the FRG. 


J 
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In the following, the area in question will be considered as a 
whole as well as in some of its parts. These parts correspond to 
the shoots of the official maps of the Federal Republic of Ger- 
many, scale 1 : 200,000 (TDK 200; Fig. 2), 


2 . Data Base 
2 . 1 Maps 

Of all the types of existing thematic maps showing distribution 
patterns of specific phenomena, two are of special interest with 
regard to superimposing with satellite images. The first type is 
the distribution pattern of land-use types, in which the illustra- 
ted area is composed of " sub- surfaces H , each class of sub-surface 
representing a particular geographic quality, as is the case with 
land-use maps. The binary distribution maps of a land-use category 
(binary mosaic map) , such as those for forest distribution or the 
distribution of tilled or settled acreage in a given area, are spe- 
cial cases of this type. The second map-type is comprised of the 
iso-line representation of a continuum, i.e., of a continuous field 
which fills the observed area, as e.g, the contour representation 
of land forms. On the other hand, maps constructed on the basis of 
a network of linear elements, such as the network of rivers, streams, 
lakes, etc., of an area, can only be used for orientation purposes 
or as a frame of reference, since, because of the extraordinary 
broadness of the line, the image-elements which appear on the map 
as bodies of water must not necessarily represent water in the sa- 
tellite image, too. 


One example of each of these two map-types has been selected for 
investigation (Fig. 3a) . In choosing an appropriate scale the geo- 
metric resolution of the satellite thermal-image was the decisive 
factor. Assuming the smallest possible size of the map-elements 
to be 0.3 mm x 0.3 mm, the pixel size of 600 m x 600 m corresponds 
to a scale of 1 : 2,000,000. Therefore, in the digitalization 
(cf. 3.1) maps of the scale 1 : 1,000,000 and 1 : 2 ,000 ,000 have 
been employed. The originals have been taken in part from the at- 
las "Rundesrepublik Deutschland in Karten", in part they are work 
ing-copios from the "Hydrologischen Atlas der BRD" . Fig. 3b shows 
as an example the forest distribution map which has been used in 
this study, The relevant sheets of the Topographical Map of Federal 
Republic of Germany, scale 1 : 2,000,000 (Tt)K 200, Fig. 2), served 
as the basis for the geometric rectification and the fitting of the 
ent ire data— structure to the Gauss-Kriiger Coordinate System. 
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Contents 

Type 

Scale 

Source 

Relief 

contour map 

1:2,000,000 

Hydrologischer 
Atlas der FRG 

Forest 

distribution 

binary mosaic 
map 

1:2,000,000 

Hydrologischer 
Atlas der FRG 

Urban 

built-up areas 

binary mosaic 
map 

1:1 ,000,000 

FRG in Karten 

Water 

network of 
linear elements 

1 : 2 ,000 ,000 

Hydrologischer 
Atlas der FRG 


Fig. 3a; Overview of the thematic maps which have been digitized 
and with which thermal images have been superimposed. 


2.2 LANDSAT image sources 

As above mentioned LANDSAT image data were used as a further data 
base. These data were produced in connection with an investigation 
of the application-possiblities of satellite- image data in the 
regional planning sector { 43 . Specifically, the data sources are 
two LANDSAT scenes of southwestern Germany, the one dated 8/9/1975, 
the other 8/28/1 975, both of which were geometrically rectified 
and adapted to the Gauss-KrUger coordinate system. Segments of both 
scenes have been fitted together so as to form a mosaic which co- 
vers the map CC 7110 (Mannheim, scale 1:200,000). Each pixel of 
the rectified and CC 7110-fitted scenes describes a surface of 
100 x 100 m 2 (1 ha) . The following 8 classes were established by 
multispectral classification; 'high-density urban built-up, low den- 
sity urban built-up, water, pastures and orchards, tilled acreage, 
vineyards, deciduous forest and coniferous forest. The so classified 
scene is available as a data- structure which can be combined with 
other data sources. Fig. 14 demonstrates the combination of the 
classified scene with the information of the topographical map for 
the same region. In the present investigation the combination was 
carried out using the infrared data of the HCMM satellite (cf. 
sections 5 and 6 of this paper) . 


2.3 The HCMM scene 

Although the HCMM satellite has been operating for a year, there is 
at the moment (June 1979) only one image available for evaluation, 
namely from May 30, 1978, 2:13 GMT (Fig. 6). This is because, first- 
ly, the high degree of cloud coverage over Central Europe renders 
many images unusable and, secondly, due to scheduling conflicts 
with other NASA programs, the European ground stations in Madrid 
and elsewhere could not register data during the clear-weather 
period of October 1978. 

On the other hand it has not been a disadvantage that the studies 
on combining thermal information with the afore-mentioned informa- 
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t ions have had to be centered up until now on a single image. As 
soon as they are available, now images can be integrated easily 
Into the dat.a-structuros which have already been produced and can 
be thus subjected to multi-temporal ooservation. 


i/.j. 


e. s *• J- 'V ^ 








Efc 






3b: F< rest Distribution in South-West Germany from Hvdrolo 
tj.^cher Atlas dor Bundesrcpublik Deutschland. 








3. Preparation of auxilary data (map digitalization) 

Map digitalization was achieved by scanning 6xt cm* elides with 
a DICOMED-Flying-Spot-Scanner (DXBIAS System) . This system allows 
a resolution of the image in 1024 x 1024 pixels. Considering the 
extension of the Upper Rhine Valley and its surroundings this re- 
sult in a pixe 1 size of ca. 350 x 350 m 2 (cf. Pig. 2), This re- 
solution corresponds approximately to the accuracy of the map: 

350 m $ 0.35 mm and 0.175 wm in scales of 1:1,000,000 and 

1:2, 000 , 000 , respectively. At the same time it is somewhat better 

than the geometric resolution of the thermal-image. 

The digitizing of gray levels which aopoar on the maps presen- 
ted considerable difficulties. It proved to be impossible to carry 
out the digitalization of a gray tone scale with more than two le- 
vels in one step. Furthermore, because of vignetting effects the 
binary black and white prints also show a strong distortion of the 
image contents. Using the relief map as an example, the solution 
to this problem is described below. 

When it became apparent that the separation of the gray values for 
the digitalization of the five elevations on the relief map would 
not be possible using the available apparatus, the elevations were 
removed one by one from the original map according to the strip 
mask procedure #). They are thus represented on the film by 
black patches. These five photos, to which scanning markers were 
added, as v*all as a sixth transparency which contains only scan- 
ningmarkers, are designated I, , l«, I., I,, I- and T correspon- 
ding to the following legend: 1 A J * 


X 1 

0 

- 200 m 

X 2 

200 

- 400 m 

X 3 

400 

- 700 m 

X 4 

700 

- looo m 

X 5 


-• looo m 


T scanning markers only 


In the digitalization the most exact coordination of the five ima- 
ges that was possible was achieved by careful adjustment of each 
image on the scanning frame, using a magnifying glass and the pass 
markers. The numerical fields (matrices) thus produced are called 
I 1 ' , I 2 ', I 3 ’ , I 4 ', Tg', and T' . The super imposition of any two 

of the I. in the interactive colour monitor (COMTAL) of the PIBIAS 
system snowed that because of smaller fitting errors and a little 
play in the scanning frame of the digitizer, the digitized cle- 


* ) 

We wish o thank II. J. Paul of the Geographical Institute of the 
University of Freiburg for help and advice during the prepara- 
tion and realization of the maps. 
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vat ion levels did not completely fit together. The overlaps aeU 
gaps which thus arose have been made visible by colour r*w»>st*n- 
tation and could be corrected by shifting individual images by 
one to two pixels. The necessary shifts correspond to errors in 
the scanned imagos of 1/20 mm and 1/10 mm, respectively. 

In this way the five digital elevation-images could be joined to- 
gether to form a map - provided each were already binary. But this 
is not the case, since even in the scanning of a black and white 
print far more than just two gray tones will appear in the digi- 
talized imago. This is caused by 

o vignetting effects (shadowing on the edges) during the photogra- 
phic production of the respective copy 1^, 

o vignetting effects from the digitizing device, 

o eclipse- or illumination-effects at the borders of bright 
and dark . 

Because of vignetting, a white background becomes darker towards 
the edges of the image, but the black elevation representations 
are also subject to this distortion (Pig. 4a, b) . The threshold, 
which must be established to produce a binary scene, would there- 
fore be position-dependent. As a corrective measure the digital 
image T' of the completely white transparency T has been used. 

Since it was produced under the same conditions as the imagos 
I-,', ..., Ijj', T* contains the same vignetting-effects (Pig. 4c). 

By subtracting the gray values of the image T‘ from those of I* 1 , 
one obtains images ' 1 which are free of vignettes . The equation 

is !'• * I' t 180 - T' (MM-Module of the DXBIAS-Systom, [5]). 
Accordingly? the cross section of the image I . 1 which appears in 
Pig. 4b obtains after correction the shape shown in 4d. 


Even after correction of vignetting there remains at the dark- 
bright-edges a gradual transition from white to black (Fig. 4a) . 
Therefore, for the construction of the binary image in each case 
a threshold value must be established which ascribes the gray 
values in the transition zone to either black or white. If this 
value becomes too large, then fine white structures disappear in 
the black environment. The opposite occurs if the threshold value 
is too small. This threshold value (gray value 144) was ascertained 
interactively on the monitor screen. Finally, every elevation was 
characterized by a definite gray value according to the statement 


I i " » g i if I i * ' < 144 
0 otherwise 


with the following values for g,^: 


W I 


gray value 



tray value* 


d) 





i A 

gray value 



1 80 

170 

ISO 


* position 

B 



white 


black 


1: Sketches representing the suppression of vignetting in 
digitalized maps prior to the production of a binary 
scene. 

a) Because of position-dependent illumination of the 
image during the photographic production of the 
inv-> e-copy and during scanning undesired light 
intensity oscillations become evident in the images 


b) Profile ol section AB from Fig. 4a in the case of a 
typical edge-shadowing. 


A<i 


' - yd 

%% 




c) A section in u completely white image ( "vignet I. ing- 

lmuge" T’ ) corresponding to the profile of section AH 
in Fig. 4a. 


d) Result of correction by means of the equation 

I ’* = I ^ * + 180 - T* (Subtraction of the vignetting- 

image from the respective scene and shift of the values 
into a region of medium gray tones). 



Image 

Elevation 

Characterizing Gray Value g A 

T 1 • l 

A 1 

0 - 200 m 

230 

X i l • 

l 2 

200 - 400 m 

180 

v III 

3 

400 - 700 m 

130 

V" 

700 - 1000 m 

80 

V* 

> 1000 m 

30 


Following this preparation the five individual images have been 
merged by the ME-modulo l 5 1 into a five-channel image and then 
assembled by the MM-ntodule 1 5 1 according to the following formula 
to form a relief map with the five elevations in one channel: 
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The relief maps which are produced in this way still show > us 
(gray value * 0) at the borders between adjoining elevation,../ 

These arise during the removal of the elevations from the original 
map, because with the stripmask procedure the contour lines them- 
selves are not reproduced, i.e., the lines are attributed to nei- 
ther of the adjoining elevations. The gaps were divided equally 
between adjoining elevations by means of a special extension oper- 
ator of the DIBIAS-system (BS-module, [5) ). 

The maps representing the distribution of forests, built-up areas 
and rivers were digitized similarly. Special mention must be made 
of the type of vignetting-effect in the distribution map of built- 
up areas and the corresponding correction procedure. Here the 
vignetting consisted in a darkening tendency which ran diagonally 
in a swath across the image increasing gradually from lower left to 
upper right. The decrement of the gray-value of white surfaces of 
25 points from the lower left to the upper right corner has been 
ascertained by means of microdensitometric sections parallel to the 
diagonal. By addition of a correction terra the gray-values have 
been standardized in the following equation, thus: 


GR new ~ GR olcl + (ZE - SP) • 25 ' /ZZ 

GR - gray-value, ZE ~ line number, SB = column number 

i ! . 

ZZ = number of lines in the image. 


After digitizing all maps were fitted to the Gauss-KrUgei coordi- 
nate system and in this way to each other. This occurred according 
to the same procedure which was used to rectify the thermal-image 
and which will therefore be described in detail in section 4 of 
this paper. Finally, with the corner points having been given in 
Gauss-Krtlger coordinates, similar "windows" were cut from the in- 
dividual maps and digitally superimposed; this served as a quality 
control of the processing procedure. Fig. 5 shows the relief map 
superimposed with the urban built-up distribution and water network 
which were produced in this way (the former represents only the 
German part of the territory investigated. 


Fig. 5: Result of the digitalization of different maps. 

Superposition of the relief with the distribution 
pattern of urban built-up areas and the river 
network . 

ORIGINAL PAUL US 
OF POOR QUALITY 






Fig. 6: A section of the thermal infrared HCMM-satellite image 
(5/30/78, 2:13 GMT). The section shows the Rhine Valley 
between Basel and Frankfurt and the surrounding high- 
lands (bright ►warm, dark ►cold). 





4. Processing the thermal-image 

4.1 Geometric adjustment to the Gauss-Krtiger coordinate network 


4.1.1 Theory 

The geometric rectifications in this investigation have been car- 
ried out by the interpolation method. This method assumes that be- 
tween a distorted seem V and a reference-image R there exists a 
functional dependence 1 

R = P (V) 

and that a rectified scene E can be produced by the operation P 
on V, thus 


E * F (V) 

The parameters for F are derived from R and V by the control point 
method, i.e., corresponding control points are sought in the re- 
ference-image R and the distorted scene V and their respective co- 
ordinates are determined in both coordinate systems. This align- 
ment results in a transformation equation, by which all points of 
the distorted scene can be related to the reference- image. 

The following symbols will be used in the equation below: 


V distorted scene 

T 

v * ' v i' v 2^ position-coordinates of the distorted scene 


g v (v) 


gray-value of the picture-element having 
these coordinates 


R 

r = (r 1 ,r 2 )' 

E 

1 

g E 'te* 


T 


reference- image 

position-coordinates of the reference-image 
rectified scene 

position-coordinates of the rectified scene 

gray-value of the pixel having these co- 
ordinates 


The following relationship between the coordinates of the distor- 
ted and rectified scenes has been assumed: 


v = f (x) , or 
V -| - f 1 (x 1 ,x 2 ) 
v 2 =f 2 (x 1 ,x 2 ) 

If V is generated from E by means of a projection, then the trans- 
formations in x^ and x 2 are linear (Ist-order polynomial): 
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v 2 “ B 1 + B 2 x 2 + B 3 , or 


v * C X 4- d 

with C =^ b A £ A 2^ and d = (A 3 ,B 3 ) T 

For the rectification of satellite scenes a 2nd-order polynomial 
is often used instead of the linear equation: 


v.j «= A.j x^ 

4* 

A 2 X 2 

4* 

A 3 


A 4 

x , 2 

+ 

A s X, 

x 2 + 

A 6 

x ^ 
X 2 

v 2 = B, Xl 

+ 

B 2 x 2 

4* 

B 3 

+ 

B 4 

x i 2 

+ 

B 5 X 1 

x 2 + 

B 6 

. 2 
x 2 


In order to calculate the unknown A^ and B^ the control points are 

used. The number of control points p must thereby be equal to the 
number k of unknown parameters which have to be calculated per 
transformation, with more control points available (p >k) , the 
error which appears in the polynomial approximation of the func- 
tion can be minimized by means of a least squares method. 

By the rectification an appropriate coordinate-pair (v.,v 0 ) from 

the distorted scene is connected with the coordinates (x^ ,x 2 ) in 

the rectified scene in accordance with the above equations. The 
gray-value of this pixel is calculated from the distorted scene. 

4.1,2 Definition of the control points 

In order to achieve the highest possible degree of precision the 
determination of the control points proceeds in two steps. First, 
the thermal image is corrected with respect to water-networks and 
forest distribution ("rough" rectification) . From this corrected 
image, which already represents a good geometric approach to the 
topographical map, the control points for the finai rectification 
are determined using Gauss -Kriiger coordinates ("fine" rectification) . 

The determination of the control points for the first step of rec- 
tification has been carried out on the DIBIAS-monitor screen. Here 
the thermal-image as well as the digitized and pointwise correlated 
forest distribution and water-network maps were deposited in the 
image memory of the system. In this way one can rapidly compare the 
images and easily identify their corresponding structures. As an 
auxilary aid in the present investigation a relief map was used 
additionally. Although large-area landscape-structures (the Upper 
Rhine Valley, Kaiser stuhl, large cities) were easy to recognize in 
the contrast enhanced thermal- image, the detection of control point 
pairs remained difficult. It turned out, for example, that in the 
monitor-screen comparison of structures for the region of the Upper 
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Rhine Valley no control points - except a few well-marked struc- 
tures of the Rhine itself - could be determined. The search was 
easier in the Highlands which surround the plain. Here the valleys 
with their pastures contrast strongly with the forested mountains 
and hills. They show a lower surface temperature at night due to 
differences in the heat budget between pastures and forests and 
the accumulation of cold air on the valley bottoms. One can there- 
fore define as control points the bends in a valley or the con- 
fluences of several valleys. This clear pattern of a valley network 
in the thermal image is lacking in landscapes with unforssted 
plateaus or only partially forested valley slopes, because here 
the influences of the relief and vegetation distribution on the 
surface temperatures run in opposite direction. 

Seven of the 17 control points used for the "rough" rectification 
lie on the Rhine river, 2 on prominent cornels of forests, and 8 
in the bends of valleys and valley confluences of the Highlands. 

Of the Rhino control points two or three were produced by the ri- 
ver alone, to some the strip of forest along the river banks was 
of assistance and in the case of two others on the Middle Rhine 
the influence of the (relatively warm) Rhine Valley slopes which 
follow the bends of the river was evident. 

As mentioned above the control points for the "fine" rectification 
were determined using Gauss-Kriiger coordinates. In order to achieve 
an average residual error of less than one pixel in the line as 
well as in the column-direction, it has been attempted on the basis 
of the topographical overview map, scale 1 :200 000 (TDK 200), to 
determine the coordinates for 50 to 100 control points with an 
error of less than 600 m. This requirement means the determination 
of these points on the map with an accuracy of 3 mm. For doing this 
the "rough" rectified images have been projected onto the corres- 
ponding map sections. By shifting the maps on a magnetic wall, the 
structures which correspond to the recognizable patterns in the 
thermal image, namely, relief, forest distribution, water-network, 
urban built-ups, were assigned in sub-regions of 20 to 40 km in 
diameter. Corresponding details of the thermal-image and the map 
were then identified in these partial regions. It became clear 
along the way that the control points which have been used in the 
preliminary rectification could, for the most part, not be identi- 
fied on the map with the necessary accuracy (3 mm) . This is true 
especially for the control points which were taken from the forest 
distribution data. The corresponding forest distribution patterns 
are indeed present on the map tOK 200, however, the relevant cor- 
ners and edges could only be defined with precision to about 1 cm. 

The same is true For the "heat islands" of large cities, which are 
conspicuous in thermal images and useful in small scale classifi- 
cation. But when blown up they are structureless and have such dif- 
fuse edges that it is difficult to assign control points within them. 
On the other hand the relief provides a good reference system, but 
not the bends or confluences of the large valleys (as was the case 
with the "rough " rectification) , rather , and especially, the 
many small forms in the upper parts of the drainage basins. Several 
control points on the Rhine river could thus be taken over from the 
"rough" rectification directly. 
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The 86 detected control points, for which a definition within the 
afore-mentioned margin of error was possible, are distributed 
among the different classes according to the following list: 

Bodies of water *(5 points): Three well-marked bends in the Rhine 
river, one in the Mosel river, and a corner of a lake which had 
a rather conspicuous shape. Many of the river-bends have to be 
disqualified, since it can not be unequivocally determined whether 
or not the structure which appears in the thermal image is pro- 
duced by the river itself or by the adjoining strips of forest. 

Urban built-up areas (5 points) : Although there exist numerous 
cities with populations of up to 10.000, which evoke a thermal sig- 
nal, it was possible only in a few cases (Endingen, Waldshut) to 
distinguish the respective town centers. In two other cases, how- 
ever, the corner points of large industrial built-up areas could be de 
termined. 

Land-use boundaries (18 points): The determination of land-use 
boundaries was more difficult than expected. Forest-clearings (2), 
small wooded expanses (3), forest-edges which jut out into or 
sharply recede from the adjoining landscape (9), etc., can apparent- 
ly be identified only when the borders of the pixel coincide with 
the land-use boundaries. In 4 cases land-use boundaries could be 
recognized by a prominent corner of a dam on the Rhine. 

Relief (51 points): With some reservation one can say that the 
nightly-appearing pattern of various sorts concavities was the 
most effective aid in identifying the control points on the map 
TDK 200. The valley-network of the highlands thus served, in 
addition to its application for the "rough" rectification, as 
reverence for the projection of the thermal-image onto TtlK 200. But 
essentially important here were the small but numerous forks (31) 
in the upper valley regions, which could be assigned to a definite 
image-point. Furthermore, in some places it was possible to de- 
fine with sufficient accuracy the junctions at which small peri- 
pheral valleys combine with major ones (8) as well as larger junc- 
tions (3) or bends (3) in the valleys. 

It should be noticed that for all defined categories or classes on- 
ly a few of many geographically equivalent situations were recorded 
in the thermal- image. This is due to smearing in mixed signatures 
caused by averaging the temperatures of the different objects which 
contribute to the pixel. From this point one can derive two conse- 
quences: 

Firstly the fact of this "smearing" reinforces trust in those con- 
trol points which were finally selected. Exactly those situations 
have been captured in which the phenomenon producing the signal 
was located centrally in the respective pixel. Secondly, it is to 
be expected that some of the control points which were employed 
here will not always be useful for the rectification of other 
images of the same territory, even if they are taken at the same 


It should be kepu in mind that the available portion of the ther- 
mal image contains no large bodies of water. It is assumed that 
well defined lake shores would also provide control points for 
the "fine" rectification. 


tim© of day. This is because due to different arrangement of the 
pixels , the same geographic phenomenon can be reproduced clearly 
in one image but less prominent in another one, 

4.1.3 Quantitative results and precision of the procedure 

With the control points thus defined, the entire scene (linear and 
quadratic polynomials) as well as different selected parts of it 
have been rectified with respect to the format of TttK 200 in se- 
veral computing runs. The table in Fig, 8a shows that for the "rough" 
rectification the best results reveal a r.ra.s. error of somewhat 
more than 1 000 m in both the line and column direction, for the 
'•fine'* rectification the values are 618 and 606 in in line and 468 
and 462 m in the column direction. The insignificant difference bet- 
ween the residual errors of the linear and quadratic approaches - 
618 and 468 m vs. 606 and 462 m respectively suggests that, with 
regard to the size of the investigated area (about 300 x 150 km), 
the increased time-consumption of the quadratic approach (35 min. 
calculating time vs. 18 min, for the linear approach) is not yet 
compensated by the relatively small gain in efficiency. 

The r.m.s. errors from the individual rectifications of the three 
TtlK-plates are with one exception all significantly smaller that 
one pixel of the original data. The somewhat better values for the 
plates CC 7910 (Freiburg-North) and CC 8710 (Freiburg-South) can 
well be attributed to the investigators ' long experience with this 
area, especially by the previous work with aircraft scanner thermal 
Imagery, which facilitates the selection of control points in this 
region. 


The fact that after the linear rectification no more essential sy- 
stematic distortions are present in the image is shown in the r.m.s. 
vector diagrams of the individual control points (Fig. 8b, 8c): the 
vectors in the different parts of the image exhibit no specific ten- 
dencies . 

This argumentation using r.m.s. errors and vector-diagrams of r.m.s. 
errors contains a high degree of abstraction and, in addition to 
that, offers no compelling proof of the quality of a rectification 
since it would hide, for example, a systematic additive error 
(translation). Therefore, in Fig. 9 to 11 the results of the recti- 
fication will be presented by using images as examples. Figs. 9 
and 10 show the entire scene following the preliminary rectification 
and the section of CC 7110 (Mannheim) following the "fine" rectifi- 
cation, overlaid with the corresponding topographic pattern. Fig. 

11a shows the surface- temperature distribution within the city 
boundaries of Freiburg- im-Breisgau as recorded in a satellite ther- 
mal-image and after "fine" rectification with respect to Gauss-Krti- 
ger coordinates and "smoothing" of the pixel edges. Fig. 11b is 
taken from an aircraft scanner thermal image of the same region pro- 
duced under comparable conditions* 























Fig. 8b: Diagram of the r.m.s. vectors in the "fine" recti- 

fication of the entire scene; left, quadratic and 
right linear. For a clear representation the vector 
length have been stretched by a factor of 8 rela- 
clve to the scale of the drawings. 
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Fig . 8c: Diagram of the residual vectors in the "fine" recti- 

fication in accordance with Tl)K 200 map plates (cf. 
the last 3 lines in Fig. 8a) , As in Fig. 8b the vec- 
tor lengths have been increased by a factor of 8. 
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F'O 10 Thermal image (a sc> ton of TUK 200 sheet CC 7110 Mannheim) after the second step in ♦he 
rectification (“fine rectification third to the last une in Fig 0a) The superimposed information is from a 
topographical map 
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I’a: Surface-temperature distribution witnin the city of 

Freiburg on 5/30/79, 2:13 GMT (preliminary calibration), 
as revealed by the HCMM thermal -image following "fine- 
rectification and "smoothing" of the pixel edges. 



11b: Surf ace-temperature distribution within Freiburo, taken 
from an aircra 't scanner thermal image from 4/1/76 
3:40 GMT, 4 000 m height above ground, resolution of the 
original pixels: 10 m. 
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4.2 Calibration, gray- level slicing, pseudocolour coding 

The figures of this paper represent all HCMM-Data as temperature 
images in Celsius degrees. This has been used, because of better 
clearness, although the calibration of the data is not yet sure 
depending on several reasons: 

• the effect of different emission capacity of the surface, which 
is not discussed here; 

• the influence of the atmosphere on the recorded thermal data, and 

• special problems of the NASA with regard to the calibration of 
the HCMM-data . 

Since some characteristics of the HCMM sensor had changed after 
the launch, the internal calibration is not correct. Two experi- 
ments to get ground truth information in summer and autumn 1978 
near White Sand in New-Mexico led to results which differed for 
about 5-6 degrees. Using the measurements of White Sands the origi- 
nal calibration procedure would result in values which are for 
images of May 1978 about 5.2 degress to high [6]. This error has 
been corrected of NASA when recording the CCT's (which was unknown 
to the authors) and during the evaluation, that means, at the pre- 
sent time to all temperatures of HCMM-images within this paper a 
constant of eh-out 6 degrees has to be added. 

Por the reproduction of the temperature values in the DIBIAS system 
a "standardized" gray scale between 0 and 255 has been used with 


the following reference: 
gray value 

temperature 

80 

0°C 

84 

1°C 

88 

o 

o 

cm 

m m m 

• • • 

100 

5°C 


For the pseudocolour representation in Fig. 13 and 18 a 1 -degree 
scale with the following colour key has been used: 


violett 

-3 

to 

0 
0 
CM 

1 

yellow/green 

3 

to 

4° 

dark blue 

-2 

to 

-1°C 

yellow 

4 

to 

5° 

blue 

-1 

to 

0°C 

orange 1 

5 

to 

6° 

light blue 

0 

to 

1°C 

orange 2 

6 

to 

7° 

cyan 

1 

to 

2°C 

red 

7 

to 

8° 

green 

2 

to 

3°C 

dark red 

8 

to 

9° 
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b. The construction of the multi-channel scene 

As a result of the processing steps described above the following 
spatially correlated, digitized, and rectified image-information 
from the investigated area was derived: 

• the HCMM-night-infrared- image-data with calibrated gray valdes; 

• the HCMM-night-infrared** image-data with calibrated gray values 
which were also adapted to the temperature pseudo-colour-scheme; 

• the network of urban built-ups; 

• the forest distribution; 

• the relief for the area represented in map CC 7110 

• and the classified image data described in section 2. 

By means of the ME-module (Merge-Modul, cf. [5]) the individual 
scenes have been transformed into two multi-channel scenes: one for 
the entire area under investigation and a second for the region 
represented in CC 7110. 

The content of the various channels in the first multi-channel scene 
is sketched in Pig. 12a. 

A pixel £ of this scene is thus a vector in six dimensions 
(g 1 , g 2 » g 3 , c -*4' g^) ; vec *- or components correspond to the 

following categories: 



= 230 
= 180 
= 130 
* 80 
= 30 


elevation 0 - 200 m 

" 200 - 400 m 

M 400 - 700 m 

" 700 - 1000 m 

" > 1000 m 


g 2 : ~ 0 urban built-up 

=255 no urban built-up 

g 3 : “ 0 forest 

= 255 no forest 

g 4 *. = 0 body of water 

=255 no body of water 

g^: 0 *' g,- 255 HCMM-night-IR-data , calibrated 

9 ^: 0 •• g^ u 255 HCMM-night-IR-data, calibrated 

and adapted to the temperature 
pseudo-colour-scheme . 

The second multi-channel scene overlays a portion of the map 
CC 7110. It was produced in a procedure similar to the one des- 
cribed above and consists of the following eight channels; 
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channel 6: HCMM data, 
calibrated and adapted to the 
pseudocolours 

Jchannel 5; HCMM data, calibrated 


|channel 4: water ways 

[channel 3: distribution of forest 

ichannel 2: distribution of built'- up areas 

channel 1 : relief 


Fig. 12a: Data structure of the multi-channel scene for the 

whole area under investigation. 


K 1 LANDSAT classification according to section 2. 

K 2 HCMM-night-lR data, calibrated. 

HCMM-night-IR data, calibrated attd adapted to 
J the temperature pseudo-colour-scheme. 

k 4 HCMM-night-IR data, calibrated, averaged, and 

adapted to the temperature pseudo-colour scheme. 

K 5 relief 

Kg urban built-up 

water-ways 

Kg forest distribution. 

6 . Examples of evaluation 

The data structures described in chapter 5 allow the combination 
of the different channels with their special information. A diver- 
sity of questions can be investigated with respect to the depen- 
dence of the surface temperature on other surface characteristics. 

Thus these data structures are useful aids for the investigation 
of the "thermal conditions of different parts of the landscape" f2]. 

In the following some examples of evaluation will be presented. 

6.1 Surface temperature and relief 

Fig. 6 demonstrates already that the relief of a landscape is re- 
flected in thermal infrared images recorded at night, that means, 
that the relief has an essential influence on the surface temperature. 
One possibility to investigate this correlation is the extraction of 
the thermal data for several elevation levels of the thermal image. 

The thermal images of the different elevation levels produced by 
this procedure (Fig. 13) demonstrate what kind of parameters in- 
fluence the surface temperatures. Thus the highest surface tempera- 
tures (without consideration of the large cities) do not occur in 
the Rhine Valley (0 - 200 m) but at the slopes of the highlands. 

These are in the northern part of the Rhine Valley mainly the re- 
gions between 200 and 400 m and in the southern part those between 
400 and 700 m. Very warm are isolated elevations between 400 and 
700 m, e.g. in the northern part of the Voges montains. Relatively 
high however, are the temperatures of the Rhine Valley in comparison 
t;o the plains of the highlands, e.g. in the region east of the 
Black Forest. In the great shallow depressions which can be found 
there in about 700 m, occur the lowest surface temperatures of 
south-west Germany. This discussion could be continued, but the 
above mentioned hints demonstrate already, that the thermal images 
of different elevation levels can be used in order to investigate 
how the altitude of the surface and how the relief of its environ- 
ment will have an influence on the temperature of the surface at 
night. 
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6.2 Surface temperature and land-use 

Besides the relief, different land use types will be reproduced in 
the thermal image, depending on their individual heat budget. Thus 
in Pig. 6 the cities of Basel, Strasbourg, Mannheim and Frankfurt 
appear as warm areas, similar to extended forest areas in the Rhine 
Valley or in the highlands. Using this fact, the data structures can 
be used to separate Individual land-use types and to quantify the 
Influence of the special type of land-use on the surface temperature 
For the region of the topographical map CC 7110 (1:2,000,000, Mann- 
heim) , for which the Landsat derived land-use classification has 
been integrated into the data structure, statistics of the surface 
temperature for each land-use type can be calculated. Without regar- 
ding the influence of the relief, this evaluation has been calcu- 
lated for the elevation level 0 - 200 m, according to the elevation 
of the Rhine valley (Fig. 15). The gray values 90, 100 and 110 of 
the abscisse in Fig. 15 correspond to the temperatures 2.5, 5 and 
7.5 oc. For the better understanding of the evident correlation of 
the surface temperature with the type of landuse, the whole region 
of CC 7110 has been overlaid with a grid of 5 x 5 km 2 (Fig. 16) . 

For each of these squares the distribution of the different land- 
use classes can be calculated. Fig. 17 is an example of this cal- 
culation for four of these squares, containing the distribution of 
the classification, the parts of built-up and forest areas derived 
from the digitized maps and the mean surface temperature of the HCMM 
data. The values demonstrate , that high surface temperature coin- 
cides with large portions of built-up areas and that low surface 
temperature coincides with large portions of agricultural land. On 
the other hand the question arises, why the large area of forest in 
square No. 3 (Bienwald) does not produce high temperatures. 

To investigate these problems more carefully, the data of the 
nearly 150 squares will be evaluated with a regression analysis. 

6.3 Surface temperature and built-up areas 

Of special economical interest are the patterns of the surface tem- 
perature of the built-up areas. At the beginning it was unknown 
whether the resolution of 600 m of the HCMM satellite was suffi- 
cient for the recording of certain built-up areas, the determi- 
nation of the thermal structures in highly populated regions and 
the comparison of different built-up areas. Fig, 11a demonstrated 
already, that the HCMM image, with the impact of geometrical 
rectification, allows a correct overview of the city of Freiburg 
im Breisgau. Fig. 18 is an example of a survey over the surface 
temperature of all built-up areas within CC 7110, using an appro- 
priate subset data structure derived from the Landsat classification 
This example contains the surface temperature derived from the IlCflfl- 
image and the cities and inner city regions of the Landsat classifi- 
cation, thus giving an overview of the large cities (Mannheim/Lud- 
wigshafen, Karlsruhe, Kaiserslautern) and permits a comparison 
of the temperature of cities of the same area and their environ- 
ment. 
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Fiq 14 Land use map of TUK 200 CC 71 10 (Mannheim) derived from Landsat data The image shows the results 
of the classification with an overlay of the topographic map Meaning of colours dark red city red 
mixed urban or built up land light green orchards and pasture yellow agricultural land, violet vine- 
yards blue water dark green coniferous forest and green deciduous forest 
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This figure represents temperatures of all surfaces with 
elevations of less than 200 m in the region of CC 7110 
(Mannheim) . 

Grid-distance 5 km. This will be used in order to derive 
the correlation between the average surface temperature 
of a square element of landscape and the relative distri 
bution of the land-use classes within this square. 







zr 


l 


I 


9 1 


k- 


I 


* a 








* V 




# 1 . 


e: 


£ 


This figure represents temperatures of all surfaces with 
elevations of less than 200 m in the region of CC 7110 
(Mannheim) . 

Grid-distance 5 km. This will be used in order to derive 
the correlation between the average surface temperature 
of a square element of landscape and the relative distri- 
bution of the land-use classes within this square. 
























7. Conclusions 

The evaluation of the described data structure is not complete with 
ihe presented examples, however, tho investigations described In this 
paper demos t rates 

• which accuracy can bu achieved for the geometrical rectification 
of HCMM-data onto the coordinate system of topographical maps; 

• that it is useful to correlate the rectified HCMM-data with other 
Information , e.g. thematic maps of preprocessed Landsat-data. 

The examples presented for the geometrical rectification of HCMM- 
data with an r,m,s. error off less than one pixel an>, in our opinion, 
tho best that can be achieved with the algorithms used. Better re- 
sults could bo obtained with the digitizing off the maps, iff devices 
coasted which allow scanning without a reduction in the size of the 
maps and without tho photographic discrimination off the gray levels, 

Tho investigation of the heat budget of several landscape types, 
which is the background aspect, may be extended in two directions; 

• HCMM images off several recording dates, preferably images of day 
and night of the same date, must be included in the data struc- 
ture, as soon as they are available. 

• Maps of the air temperature distribution for the dates of image 
recording should be integrated into the data structure. 

The knowledge of the daily amplitude of the surface temperature and 
the differences to the temperature off the air (the correct calibr- 
ation presumed) would allow the investigation of regional heat 
budgets . 
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ERRATUM 


The numbers of pages 33 and 37 have been exchanged: 

Pig* 14 should be on page 33 

Pig. 18 should be on page 37 




